Description

This PR adds Full text search and hybrid search support.

• Adds hybrid search query pipeline stage HybridSearchDocumentQueryExecutionContext
• Adds a new query feature HybridSearch
• Adds a new query info HybridSearchQueryInfo

Design doc

FTS queries supported now:

• SELECT TOP 50 c.id, c.abstract, c.title FROM c WHERE FullTextContains(c.abstract, 'quantum')
• SELECT TOP 50 c.id, c.abstract, c.title FROM c WHERE FullTextContainsAll(c.abstract, 'quantum', 'theory')
• SELECT TOP 50 c.id, c.abstract, c.title FROM c WHERE FullTextContainsAny(c.abstract, 'quantum', 'theory')
• SELECT TOP 50 c.id, c.abstract, c.title FROM c ORDER BY RANK FullTextScore(c.abstract, ['quantum', 'theory'])
• SELECT TOP 50 c.id, c.abstract, c.title FROM c ORDER BY RANK RRF(FullTextScore(c.abstract, ['quantum', 'theory']), FullTextScore(c.abstract, ['https://github.com/Azure/azure-sdk-for-java/issues/43011model']))
• SELECT TOP 50 c.id, c.abstract, c.title FROM c ORDER BY RANK RRF(FullTextScore(c.abstract, ['quantum', 'theory']), FullTextScore(c.abstract, ['model']), VectorDistance(c.Embedding, [%s]))",vector)

Hybrid Search queries guide

Follow ups to this PR:

• [Cosmos FTS] Expand full text search testing coverage #43007
• [Cosmos FTS] Fix the diagnostics not being populated for full text search queries #43008
• [Cosmos FTS] Adding query samples for Full Text Search and Hybrid Search #43011

All SDK Contribution checklist:

• The pull request does not introduce [breaking changes]
• CHANGELOG is updated for new features, bug fixes or other significant changes.
• I have read the contribution guidelines.

General Guidelines and Best Practices

• Title of the pull request is clear and informative.
• There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

• Pull request includes test coverage for the included changes.